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Abstract — In this work, a non-cooperative power control game 
for multi-carrier CDMA systems is proposed. In the proposed 
game, each user needs to decide how much power to transmit over 
each carrier to maximize its overall utility. The utility function 
considered here measures the number of reliable bits transmitted 
per joule of energy consumed. It is shown that the user's utility 
is maximized when the user transmits only on the carrier with 
the best "effective channel". The existence and uniqueness of 
Nash equilibrium for the proposed game are investigated and 
the properties of equilibrium are studied. Also, an iterative and 
distributed algorithm for reaching the equilibrium (if it exists) 
is presented. It is shown that the proposed approach results 
in a significant improvement in the total utility achieved at 
equilibrium compared to the case in which each user maximizes 
its utility over each carrier independently. 

I. Introduction 

Power control is used for resource allocation and interfer- 
ence management in both the uplink and downlink of code 
division multiple access (CDMA) systems. In the uplink, the 
purpose of power control is for each user to transmit enough 
power so that it can achieve the required quality of service 
(QoS) at the uplink receiver without causing unnecessary 
interference to other users in the system. Game theory has 
been used as an effective tool to study power control for data 
networks (see for example [1-6]). Taking this approach, it 
is shown in [1] and [3] that Nash equilibrium is achieved 
when all the users aim for a target SIR, 7*. This is true even 
when the matched filter is replaced by the decorrelator or the 
minimum mean square error (MMSE) receiver as shown in 
[4]. Nash equilibrium is a set of strategies such that no user 
can unilaterally improve its own utility (which is a measure 
of user satisfaction) given the strategies taken by other users. 
Extension of the above results to multiantenna systems are 
also presented in [5]. 

Multi-carrier CDMA, which combines the benefits of or- 
thogonal frequency division multiplexing (OFDM) with those 
of CDMA, is considered to be a potential candidate for next 
generation high data-rate wireless systems (see [7]). In this 
work, we consider an orthogonal multi-carrier DS-CDMA 
system and propose a non-cooperative power control game in 
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which each user tries to choose its transmit power over each 
carrier to maximize its overall utility. For the proposed game, 
we will address the following questions. When does a Nash 
equilibrium exist? What kind of carrier allocations among the 
competing users will occur at a Nash equilibrium? Will there 
be an even spread of usage of the carriers among users? How 
does this approach compare with an approach in which each 
user simply optimizes over each carrier independently? 

The rest of this paper is organized as follows. In Section Ull 
we provide some background for this work by discussing the 
power control game for the single-carrier case. The power con- 
trol game for multi-carrier systems is presented in Section Hill 
The Nash equilibrium and its existence for the proposed game 
are discussed in Section IIVI and a distributed algorithm for 
reaching the equilibrium (if it exists) is presented in SectionlVl 
The case of two-carrier systems is studied in more details 
in Section IVII Numerical results and conclusions are given 
in Sections IVIII and IVIIII respectively. Our focus throughout 
this work is on the uplink, where user terminals transmit to a 
common concentration point such as a cellular base station. 

II. Background 

Let us first look at the power control game with a single car- 
rier. To pose the power control problem as a non-cooperative 
game, we first need to define a utility function suitable for 
data applications. Most data applications are sensitive to error 
but they can tolerate delay. It is clear that a higher signal to 
interference plus noise ratio (SIR) level at the output of the 
receiver will result in a lower bit error rate and hence higher 
throughput. However, achieving a high SIR level requires the 
user terminal to transmit at a high power which in turn results 
in low battery life. In [1], the utility function of a user is 
defined as the ratio of its throughput to its transmit power, i.e. 



Throughput is the net number of information bits that are 
transmitted without error per unit time (sometimes referred 
to as goodput). It can be expressed as 

Tk = jjRkfilk), (2) 



where L and M are the number of information bits and the 
total number of bits in a packet, respectively. Rk and 7^ are the 
transmission rate and the SIR for the fc*'* user, respectively; 
and /(7fc) is the efficiency function representing the packet 
success rate (PSR), i.e. the probability that a packet is received 
without an error Our assumption is that if a packet has one 
or more bit errors, it will be retransmitted. The efficiency 
function, /(7fc), is assumed to be increasing and S-shaped 
(sigmoidal) with /(oo) — 1. We also require that /(O) — 
to ensure that u^. — when pi^ = 0. These assumptions are 
valid in many practical systems. It should be noted that the 
throughput Tk in (|3 could be replaced with any increasing 
concave function as long as we make sure that Uk ~ when 
Pfc = 0. A more detailed discussion of the efficiency function 
can be found in [6] and [8]. Note that for a sigmoidal efficiency 
function, the utility function in Q is quasiconcave in user's 
transmit power This is also true if the throughput in (|2j is 
replaced with an increasing concave function. 

Based on Q and (|2j, the utility function for user k can be 
written as 

L „ /(7fe) 



Uk 



M pk 



(3) 



This utility function, which has units of bits/Joule, captures 
very well the tradeoff between throughput and battery life and 
is particularly suitable for applications where saving power is 
as important as achieving a high throughput. 

Power control is modeled as a non-cooperative game in 
which each user tries to selfishly maximize its own utility. It is 
shown in [3] that, when matched filters are used as the uplink 
receivers, if user terminals are allowed to choose only their 
transmit powers for maximizing their utilities, then there exists 
an equilibrium point at which no user can improve its utility 
given the power levels of other users (Nash equilibrium). The 
equilibrium is achieved when users' transmit powers are SIR- 
balanced with 7*, the solution to f{-y) = 7 f'{j), as the output 
SIR. Furthermore, this equilibrium is unique. 

In this work, we extend this game-theoretic approach to 
multi-carrier systems. 

III. The Non-Cooperative Power Control Game in 
Multi-carrier Systems 

Let us consider the uplink of a multi-carrier DS-CDMA 
data network with K users, D carriers and processing gain 
(for each carrier). The carriers are assumed to be sufficiently 
far apart so that the (spread-spectrum) signal transmitted over 
each carrier does not interfere with the signals transmitted over 
other carriers. At the transmitter, the incoming bits for user k 
are divided into D parallel streams and each stream is spread 
using the spreading code of user k. The D parallel streams are 
then sent over the D (orthogonal) carriers. For the i?*'* carrier, 
the received signal at the uplink receiver (after chip-matched 
filtering and sampling) can be represented by an TV x 1 vector 
as 



K 

E 

k=l 



\/ Pkihki bke Sfe 



(4) 



where bke, Pke, hkt are the fc*'* user's transmitted bit, transmit 
power and path gain, respectively, for the frequency 



channel (carrier), is the spreading sequence for user k 
which is assumed to be random with unit norm; and is 
the noise vector which is assumed to be Gaussian with mean 
and covariance cr^I. The matched filter output SIR for the 
carrier of the k*-^ user is, therefore, given by 



Ikt 



(5) 



We propose a non-cooperative game in which each user 
chooses its transmit powers over the D carriers to maximize 
its overall utility. In other words, each user (selfishly) decides 
how much power to transmit over each frequency channel 
(carrier) to achieve the highest overall utility. Let Go — 
[/C, {A*^*-^}, {m^^*-^}] denote the proposed non-cooperative 
game where JC = {1, ...,K}, and Af^ = [Q,Pynax]° is the 
strategy set for the k*-^ user. Here, Pmax is the maximum 
transmit power. Each strategy in A^^'-^ can be written as 
Pfe = bfc' ■••i-Pfc']- The utility function for user k is defined as 
the ratio of the total throughput over the total transmit power 
for the D carriers, i.e. 



,MC 



(6) 



where Tke is the throughput achieved by user k over the 
carrier, and is given by Tki = ^Rkf{lki)- Hence, 
the resulting non-cooperative game can be expressed as the 
following maximization problem: 



max u 
Pfc 



MC 
k 



Pki, 



max u 

,PkD 



MC 



for k = l,...,K, (7) 



under the constraint of non-negative powers (i.e. pki > 
for all k = 1,...,K and £ — 1,...,D). Without any loss of 
generality, if we assume equal transmission rates for all users, 
Q can be expressed as 



Efci filke) 



max 



for = 1, 



(8) 



The relationship between ^ki and pki's is given by Q- 

IV. Existence of Nash Equilibrium for the 
Proposed Game 

For the non-cooperative power control game proposed in 
the previous section, a Nash equilibrium is a set of power 
vectors, pj, p|f, such that no user can unilaterally improve 
its utility by choosing a different power vector; i.e. p^^, pj^ 
is a Nash equilibrium if and only if 



,MC/ 



(p^,P*_fe)>uf^(pfc,Pl,)forall p, 



(9) 



and for fc = 1, • • • ,K; where P^^, contains the transmit power 
vectors of all the users except for user k. 
Let us define 



hke = 



h 



kl 



- -wY^j^kPii^ji 

as the "effective channel gain" for user k over the (.'^^ 
Based on (|5} and jlO> . we have ^ki — hkePki- 



(10) 



Proposition 1: For user k, the utility function in (|6} is 
maximized when 



Pki 



_ Pi 



for 
for 



i = Lk 



(11) 



where Lk = a.Tgmaxihke and pi = mm{^ , Pmax}, with 
7* being the unique (positive) solution of 7(7) = 7 /'(7). 
Proof: We first show that liS£l is maximized when 

p — 7* /a. For this, we take the derivative of ^^-^^ with respect 
to p and equate it to zero. Letting 7 = ap, we have 



?'^/'(7)-/(7) = 0. 



(12) 



we can write 



for any pki > 0, where 



Since p^ = 7, p* = mm{-f* /a, P,nax} maximizes 
where 7* is the unique (positive) solution to /(7) — 7/'(7). 
Now, without any loss of generality, let us assume that 
hki > > ■■■ > hkD- Then, based on the above argument 

fjhklPkl) ^ f(hkl'pl) 

Pk = 1* /hki- Also, because hki > hk2 > ■■■ > hko, we 
have lihMPMl < fih]^£l for all > and ^ = 2, 3, .., K. 

Pki — Pk ^'^'^ — ! ) I 

Based on the above inequalities, we can write 

f{hM) ^ P_M fo, 2,...,Z?. (13) 

!{KpI) - pV 

Adding the D inequalities given in il3\ and rewriting the 
resulting inequality, we have 

Ef=i fihkiPki) < fihk^ ^^^^ ^ ^^^^^ ^ Q 



}^e=lPki 



Pk 



(14) 



This completes the proof. □ 



Proposition 1 suggests that the utility for user k is max- 
imized when the user transmits only over its "best" carrier 
such that the achieved SIR at the output of the matched 
filter receiver is equal to 7*. The "best" carrier is the one 
with the largest effective channel gain. An alternative way 
of interpreting Proposition 1 is that the utility for user k 
is maximized when the user transmits only on the carrier 
that requires the least amount of transmit power to achieve 
7* at the output of the uplink receiver. A set of power 
vectors, p^, p*j^, is a Nash equilibrium if and only if they 
simultaneously satisfy (II It . 

It should also be noted that the utility-maximizing strategy 
suggested by Proposition 1 is different from the waterfilling 
approach discussed in [9]. This is because in [9], utility 
is defined as the user's throughput whereas here we have 
defined utility as the number of bits transmitted per joule 
of energy consumed. Another observation is that if we use 
Uk = z2e=i ^ utility function, then the utiUty for user 

k is maximized when the user transmits on all the carriers 
at power levels that achieve 7* for every carrier. This is 
equivalent to the case in which each user maximizes its utility 
over each carrier independently. 

Since at Nash equiUbrium (if it exists), each user must 
transmit on one carrier only, there are exactly possibilities 



for an equilibrium. For example, in the case of K ~ D — 2, 
there are 4 possibilities for Nash equilibrium: 

> User 1 and user 2 both transmit on the first carrier. 

> User 1 and user 2 both transmit on the second carrier. 

• User 1 transmits on the first carrier and user 2 transmits 
on the second carrier 

• User 1 transmits on the second carrier and user 2 trans- 
mits on the first carrier 

Depending on the set of channel gains, i.e. hke's , the 
proposed power control game may have no equilibrium, a 
unique equilibrium, or more than one equilibrium. Let us for 
now assume that the processing gain is sufficiently large so that 
even when all K users transmit on the same carrier, 7* can be 
achieved by all users. This is the case when N > {K — 1)7*. 
The following proposition helps identify the Nash equilibrium 
(if it exists) for a given set of channel gains. 

Proposition 2: The necessary condition for user k to 
transmit on the carrier at equilibrium is that 

hki 



> 



e 



n{i) 



60 for aUi^e , 



(15) 



where n{i) is the number of users transmitting on the i*'* 
carrier and 

1 



l-(n-l)^ 



n ^ 0,1, ...,K. 



(16) 



In this case, pke = \^Qn(i)- 

Proof: Based on Proposition 1, in order for user k to 
transmit on carrier ^ at equilibrium, we must have 

hki > K for all i ^ i. (17) 

Since n{i) users (including user k) are transmitting on the 
carrier and n{i) users are transmitting on the j*'' carrier and 
all users have an output SIR equal to 7*, we have 

hki 



hki — 



2 , n(i)-l ' 

CT^ + ^ I Qi 



N 



and 



hki 



N 1^ 



(18) 



(19) 



where qi = ^ (^(J-dt* and = (Mi'^-i)-,* are the re- 
ceived powers for each user on the I and i carriers, respec- 
tively. Now define e„ = ^ ^ to get qi = a'^j*Qn{i) 
and qi = 17^7* 8„(i). Substituting qi and qi into ( I18> and il9i 
and taking advantage of the fact that 1 + ''"^j^"'^ Qw — ©n 
we get 

t hki 



l-ki 



and 



''ki 



(20) 



(21) 



Consequently, ( I15> is obtained by substituting M0\ and Mil 
into ( I17t . Furthermore, since Pkihki = qi = cr^7*8„(f), we 
have Pki — Qk(£) and this completes the proof. □ 




hii/lii; 



Fig. 1. Nash Equilibrium Regions for tlie Case of K = 2 and D = 2 

Based on when N > {K — 1)7*, we have 

< Go < 61 < 62 < ... < Qk with 81 = 1. 

For each of the possible equilibria, the channel gains for 
each of the K users must satisfy D — 1 inequalities similar 
to M5\ . Furthermore, satisfying a set of K{D — 1) of such 
inequalities by the K users is sufficient for existence of Nash 
equilibrium but the uniqueness is not guaranteed. For example, 
for the case of K = D ^ 2, the 4 possible equilibria can be 
characterized as follows. 

• For both users to transmit on the first carrier at equilib- 
rium, we must have ^ > 62 and > 62. 

• For both users to transmit on the second carrier at 



equilibrium, we must have ^ > 02 and ^ > 02. 

• For user 1 and user 2 to transmit on the first and 
second carriers, respectively, at equilibrium, we must 

have ^ > 60 and ^ > Gq. 

"12 " '121 " 

• For user 1 and user 2 to transmit on the second and 
first carriers, respectively, at equilibrium, we must have 
^ > 60 and ^ > Go. 

/Ill " "22 " 

Fig. ^ shows the regions corresponding to the above four 
equilibria. It can be seen that for certain values of channel 
gains there is no Nash equilibrium and for some values of 
channel gains there are two equilibria. 

V. A Distributed Algorithm 

In this section, we present an iterative and distributed 
algorithm for reaching the Nash equilibrium (if it exists) for 
the proposed power control game. The description of the 
algorithm is as follows. 

1) Let A: = 1 

2) Given the transmit powers of other users, user k picks 
the carrier whose effective channel gain (i.e. hke) is the 
largest and transmits only on that carrier at a power level 
equal to pi 

3) k = k+l 

4) If k < K then go back to step 2 

5) Stop if the powers have converged, otherwise go to 
step 1 

It is clear that if the above algorithm converges, it will 
converge to a Nash equilibrium. It is also demonstrated in 



Section IVTII that the algorithm converges when a Nash equi- 
hbrium exists. In the case of multiple Nash equilibria, the 
above algorithm converges to one of the equilibria depending 
on the starting point. 

VI. Special Case of Two Carriers 

To gain some insight into the properties of the Nash 
equilibria for our proposed game, let us concentrate on a 
system with two carriers and two users (i.e. D = K = 2). 
We assume that the channel amplitudes are independent and 
identically distributed (i.i.d.) among users and carriers. If 
we assume Rayleigh fading (with mean 1) for the channel 
amplitudes then the channel gains, hk^'s, will be i.i.d. with 
exponential distribution of mean 1. Let Xi be the random 
variable corresponding to the number of users that transmit 
over the first carrier at equilibrium. If we assume N > 7*, 
then, based on Proposition 2, the probability that both users 
transmit on the first carrier at equilibrium (i.e. Xi — 2) is 
given by 



^-^1(2) 



= Pr{Xi 

= Pr 



2} 



7 > U2, 7 > "2 

1^12 1122 



1 + 62 



(22) 



Similarly, the probability of both users transmitting on the 
second carrier at equilibrium is 



PxAO) = Pr{Xi = 0} 
hi2 



= Pr 



— > <C>2,T— 

hii /i2i 



> 62 ^ = 



1 + 62 



(23) 



The probability of one user transmitting on each of the two 
carriers can be found to be 



PxA^) ^ Pr{Xi = 1} = 2 



1 



l-9o 
l + Oo 



(24) 

Consequently, the probability that no Nash equihbrium exists 
is given by 



Pn 



Pr{No Nash equilibrium} 

2 / -, X 2' 

I / l-Io \ 

2 




1 



1 + 65 



(25) 



It should be noted that as the processing gain becomes 
larger, 80 and 0i approach 1 from below and above, respec- 
tively. This results in a reduction in Pxi (1) but an increase in 
Pxi (0) and Pxi (2), i.e. the probability mass function (pmf) 
for Xi becomes flatter However, the increase outweighs the 
decrease and as a result Pq decreases as A^ increases. Going 
back to Fig. [J we see that the region for which no Nash 
equilibrium exists shrinks as A^ increases. In addition, the 
region for which more than one equilibrium exists disappears 
as A^ becomes very large. Therefore, we can say that as 
the processing gain becomes large, the probability that the 
proposed power control game has a unique Nash equilibrium 
approaches one. 

So far, the assumption has been that A^ > 7* so that both 
users can achieve 7* even when they are transmitting over 
the same carrier For the case of A^ < 7*, the users cannot 



achieve 7* simultaneously when they are transmitting on the 
same carrier and hence they would end up transmitting at the 
maximum power Therefore, when N < j*, the probability 
of both users transmitting on the same carrier at equilibrium 
is virtually zero, i.e. P^i (2) = Pxi (0) ~ 0. Hence, we have 



1+eo 

Although obtaining explicit expressions for the probabilities 
of the occurrence of various Nash equilibria for the case of 
K > 2is difficult, many of the statements made for the case of 
K = 2 are also valid when K > 2. Namely, as N increases the 
pmf of Xi becomes wider and at the same time the probability 
that no equilibrium exists becomes smaller. This means that 
in the asymptotic case of large processing gain, the proposed 
power control game has a unique equilibrium. Furthermore, for 
very large values of N, the pmf of Xi can be approximated 
as 



Pxi (m) = Pr{Xi = m} 



K 



K 



for m = 0, 



Watts; and use /(7) = (1 



as the efficiency function. 



For this efficiency function, 7* = 6.4 (=8.1dB). We assume 
that the channel gains are i.i.d. with exponential distribution of 
mean 1. We consider 20,000 realizations of channel gains. For 
each realization, we run the algorithm proposed in Section |V] 
for 20 iterations. If convergence is reached by the end of the 
20*'* iteration, we record the number of users that transmit on 
each carrier; otherwise, we assume there is no equilibrium. 
For our simulations, Pmax is assumed to be very large which 
translates to having no transmit power limit for the user 
terminal. 

It is observed that the distributed algorithm proposed in 
Section Ivl converges when a Nash equilibrium exists. Recall 
that Pxi {ni) represents the probability that m users transmit 
on the first carrier at equilibrium. Fig.|2lshows Pxi (2), Pxi (1) 
and Po (probability of no equilibrium) as a function of the 
processing gain N. The analytical expressions obtained in 
Section IVII are also plotted. We see that there is a close 
agreement between the simulation results and the analytical 
values. It is also observed that as N becomes large, Pq 
approaches zero. For N = 16, for example, the probability 
that a Nash equilibrium exists is about 93%. Since Pxi(O) is 
identical to Pxi(2), it is not shown in the figure. 

Fig-Hlshows Pxi {m) as a function of m for different values 
of iV. We can see from the figure that as the processing gain 
increases, the pmf of Xi becomes flatter. This is because for 
larger values of N, the system becomes more tolerant towards 
interference. Therefore, the probability with which the two 
users are able to transmit on the same carrier at equilibrium 
increases. 

We repeat the above experiment for the case of two carriers 
and 10 users. Fig. 0] shows Px^im) as a function of the 




(2): analytical 
. (2): simulation 
P^ (1): analytical 
■ Pj, (1): simulation 
P : analytical 




Fig. 2. Probability of having m users on the first carrier at equilibrium, 
Pxi (™), for m = 1, 2 as well as probability of having no equilibrium are 
shown for D = K = 2. 



■■ ,K. 
(26) 

In the next section, we show the validity of these claims 
using simulation. 

VII. Simulation Results 

We first consider the case of two carriers with two users. We 

assume L = M ^ 100, R = 100 Kbps and a'^ = 5 x lO'^^ 




Fig. 3. Probability mass function of Xi for different processing gains {D = 2 
and = 2) 



processing gain. Due to symmetry, we have only plotted the 
probabilities for m = 5, 6, ...,10. The probability that no 
equilibrium exists (Pq) is also shown. Similar trends as those 
observed in the case of K — 2 are also seen here. We 
observe that here again as N becomes large, Po approaches 
zero. Pxi {rn) as a function of m for different values of 
N is plotted in Fig. |5] The asymptotic approximation for 
Pxi {rn) which is given by M6\ is also shown. We see from 
the figure that as N increases the pmf of Xi becomes wider 
because the system becomes more interference-tolerant. Also, 
the equilibria for which the allocation of users to the carriers is 
highly asymmetric (e.g. m — % and 10) are unlikely to happen. 
In other words, with a high probability, the users are evenly 
distributed between the two carriers. It should be noted that 
when N is small, 7* cannot be achieved simultaneously by 
all the users at the output of the matched filters. Therefore, 
users keep increasing their transmit powers and hence no 
equilibrium is reached. This is the case until N becomes large 
enough so that it can accommodate at least 5 users on each 
carrier (i.e. > 25.6). In practice, however, if A^ is not large 
enough, some or all users end up transmitting at the maximum 
power. 

We now compare the proposed approach, which jointly 




Fig. 4. Probability of having m users on the first carrier at equilibrium, 
Pxi (iTT-), for "X = 5, 6, ■ • • , 10 as well as probability of having no 
equilibrium are shown for D = 2 and K = 10. 
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Fig. 6. Total Utility vs Number of Users (D = 2 and TV = 128) 



decide how much power to transmit over each carrier to max- 
imize its overall utility. The utility function has been defined 
as the overall throughput divided by the total transmit power 
over all the carriers and has units of bits per joule. For this 
utility function, we have shown that the utility is maximized 
when each user transmits only on the carrier which has the 
best "effective channel" for that user. In addition, we have 
derived the conditions for existence of a Nash equilibrium and 
proposed an iterative and distributed algorithm for reaching the 
equilibrium (if it exists). The properties of the Nash equilibria 
for the proposed game have been studied. We have also 
demonstrated the performance improvement resulting from the 
proposed approach compared to the approach of independent 
optimization over each carrier 



Fig. 5. Probability mass function of X\ for different processing gains {D = 2 
and K = 10) 

maximizes each user's utility over all carriers, with the ap- 
proach that maximizes user's utility independently over each 
carrier. In the joint maximization approach each user transmits 
only on the carrier that has the best effective channel whereas 
in the other case, all users transmit on all the carriers such that 
the output SIR on each carrier is 7*. We consider a system 
with 2 carriers and N — 128. We fix K and compute the 
sum of the utilities achieved by all users for 20,000 channel 
realizations. The utility for each case is the ratio of the total 
transmitted bits over the two carriers divided by the total 
energy consumed. Fig. |5] shows the average total utility vs. K 
for the two approaches. We see a significant improvement in 
the achieved utility when joint maximization over all carriers 
is used. This is because when all the users transmit on every 
carrier, they cause unnecessary interference. To achieve 7*, 
each user is hence forced to transmit at a higher power level 
which in turn results in a considerable reduction in the overall 
utility. 

VIII. Conclusion 

We have modelled power control for multi-carrier CDMA 
systems as a non-cooperative game in which each user needs to 
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